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Abstract. We present a methodology to characterize synchronization in time series 
based on symbolic representations. A symbol is linked to a sequence of numbers 
through the rank-order of its values. A representation of a time series results after 
mapping all sequences into symbols. We propose a transcription scheme between 
O ' symbolic representations to study the dynamics of coupled systems. This scheme 

C/3 . allows us to use elements of group theory and to derive information measures to assess 

^^1 the degree of synchronization. We apply our method to a prototype non-linear system 

f^ • which displays a rich coupled dynamics. 
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Figure 1. Example of symbolic representations of time series for sequence length 
p = 4. Symbols in red correspond to the representations and the green symbols 
indicate the transcriptions that have to be applied to the upper symbols (source) to 
obtain the lower ones (target). Note that this operation is not commutative. 



1. Introduction 



Synchronization phenomena are ubiquitous in Nature. They take place among coupled 
oscillatory systems. Its occurrence is not restricted to periodic systems but it is also 
observed in non-linear chaotic systems. In this case, its emergence is by no means 
trivial due to the high sensitivity of chaotic systems to initial conditions. Examples 
of synchronization arise in different fields of science like electronics (e.g. coupled 
circuits), physiology (e.g. between cardiac and respiratory systems or EEG signals) 
[U E], extended ecological systems [3] or in non-hnear optics (e.g. coupled laser 
systems with feedback). Different synchronization states have been identified in the 
study of coupled chaotic systems, namely complete synchronization [1], phase [5l [6] 
and lag synchronization [7j, generalized synchronization P, [10], etc (for a review 
about synchronization in chaotic systems see [11]). Here, we present a methodology 
to characterize synchronization in coupled systems where information measures are 
obtained using symbolic representations of time series. 



2. Method 



Let a; be a time series and q = {xq, . . . ,Xp_i) be a sequence of length p extracted 
from X. The symbol Q associated to q is defined as the rank-ordered indices of the 
components of q. For instance, for q = (1.6,1.3,1.4,1.5), the symbol associated to q 
is Q = (3,0,1,2). This symbolic representation was first introduced by Bandt et al. 
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in the context of complexity analysis of time series. This approach motivated some 
studies of the characterization of similarities in time series. For the interested reader 
see [131 [E]. It should be mentioned that the occurrence of identical values in q has not 
been considered. When the sequence contains equal values, one can always add a small 
random perturbation to avoid this case. 

Figure 1 shows symbolic representations of two time series (red symbols) for p = 4. 
Given two symbols Ai and A2 there always exists a symbol T, in the following called 
transcription, such that T[Ai] = A2. The action of symbol T is defined as follows. Let 
A = iJoJi, ■ ■ ■ , jp-i) and T = (/cq, h, . . . , kp_i). Then, 

^[^1] = (jfco>ifci>---.ifcp-i)- (1) 

It should be noted that the set of symbols form a finite non-Abelian group of order p\ 
with operation T known as the symmetric group Sp. Green symbols in Fig. 1 indicate 
the transcriptions between the symbolic representations of the time series. The group 
Sp can be partitioned into non-overlapping classes Q {Sp = \JCi) satisfying a power 
relation, namely if T G C„ then T" = /, where / = (0, 1, ... ,p — 1) is the identity 
symbol and T" is the composition TlT"^"^] with n > 1 and T° = /. Figure 2 (left 
panel) shows the transcription matrix for p = 3, where the three existing order classes, 
i.e. T = I (black symbol), T^ = I (blue symbols), and T^ = I (red symbols) are 
shown. It is worth discussing the action of transcriptions for different order classes. The 
identity transcription leaves symbols unchanged thus it is the simplest transcription. 
For p = 3, consider transcription A = (0, 2, 1) which belongs to order 2 class and apply 
it toE = (2,1,0) (see Fig. [2]). 

A[E] = D = (2,0,1). (2) 

Then, the action of A is identical to one transposition, i.e. the interchange of and 1 
in symbol E. However, if we consider B = (1,2,0) that belongs to order 3 class and 
apply it to i? = (2,1,0) the result is C = (1,0,2). We have to perform either two 
transpositions or one cyclic permutation on E to obtain C. Note that for p = 3 all order 
2 transcriptions cause a one transposition change while all order 3 transcriptions lead to 
two transpositions change. Thus, we interpret order 3 transcriptions as "more complex" 
than order 2 transcriptions. For longer sequences, we can still identify order classes in 
term of the action of their component symbols although the description becomes more 
difficult. From this point of view, the order of a class offers a rough estimation of the 
"complexity" of the transcription. 

The order classes satisfy an important property of invariance. Let A and B two 
symbols connected by the transcription T, i.e. T[A] = B and suppose that T^ = /, i.e. 
T G Cat. Let Y an arbitrary transcription such that Y[A] = C and y[B] = D. There 
always exists a transcription T' such that T'[C] = D. We will prove that T' belongs to 
order N class as well. In fact, 

T'[C] = D ^ T'[Y[A]] =Y[B]. (3) 
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Figure 2. Left: Transcription matrix for sequence length p = 3. The blue (red) 
symbols belong to order 2 (3) class, respectively. The identity symbol (black) is a 
singular one symbol class satisfying T" — I, Vn. Source symbols are displayed at 
the bottom and target symbols on the left of the transcription matrix. Right: For 
p — 5 the transcription matrix has (5!)^ elements. This matrix shows the positions 
of the elements belonging to order 2 class, i.e. the structure generated by order 2 
transcriptions for p ~ 5. 



If we apply Y ^ on the left to both sides of Eq. [3] we obtain 

Y-^r[Y[A]] = B, 
which implies 



T = Y~^T'Y. 



Since T G Cn we obtain 



(4) 



(5) 



(6) 



so T and T' belong to the same order class. This property of invariance also implies 
that T and T~^ belong to the same order class. However, an order class is not a group 
since it does not satisfy closure. Note that Eq. (JSj) implies that order classes are also 
conjugacy classes. Figure 2 (right panel) shows the structure generated by the set C2 
for p = 5. The symmetry displayed by this structure is a general property found in all 
order classes since it is a consequence of Eq. El 

The action of a transcription is just equivalent to applying permutations. It is well 
known that any permutation can be written as a product of disjoint cyclic permutations 
(DCP). Using this fact, one can prove that the order of any transcription is the least 
common multiple (LCM) of the lengths of the DCP. Since the sum of the lengths of the 
DCP equals the sequence length p, the succession of order classes is never interrupted 
up to order p. For p > 7, gaps of missing order classes always appear. For example 
for p = 7, order 8, 9, and 11 classes are missing since there is no possible splitting of a 
sequence of length 7 in DCP which satisfy the LCM condition. However, order 10 and 
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12 classes are present since one can have a combination of DCP of lengths 2 and 5 for 
order 10 and 3 and 4 for order 12. 

We now focus on the probability density of transcriptions. Consider a source and a 
target symbolic representations generated by the actual coupled dynamics of the time 
series. Given a sequence of length p, the set of all feasible symbols S^ = {Xi} and 
S"^ = {Xj} conform the state spaces for the source and the target representations, 
respectively. The probability density of transcriptions Pt{p) can be written as follows 

Pn{p)= E P'^iX^^X,), (7) 

n={ii,jy.TklXi]=x,} 

where Xj G S^, Xj G 5^, and P'"(Xj,Xj) is the joint probability density. Let 
P^^\Xi) and P^'^\Xj) be the marginal probability densities of the symbols Xj and 
Xj in state spaces S^ and iS^, respectively. The matrix Mij = P^^\Xi)P^'^\Xj) is the 
probability density matrix of transcriptions for two independent processes. In this case, 
the probability density of transcriptions P^{p) can be evaluated as follows 

PtM= E M,,, (8) 

n={{ij):Tk[X,]=X,} 

where Xj G S^ and Xj G S'^ . The aim is to find an information measure to assess 
how much Pt deviates from P^. A natural choice to quantify the contrast between 
probability densities is the Kullback-Leiber (KL) entropy defined as follows 

Ekl{P,P1 = Y.PT.Wog{PTAp)/Pm)- (9) 

i 

Since the Ekl is not a symmetric quantity, we use the following symmetrized form [16] 

c, . ^ Ekl{P.P')Ekl{P^P) .... 

^^'^^^ - EMP,P^) + EKdP^,Py ^'°^ 

We demonstrated above that order classes are also conjugacy classes. This important 
property implies that T and T"^ belong to the same order class. Thus, Skl{p) for 
transcriptions inside a class is a suitable invariant measure under the interchange of 
source and target time series. This property of invariance also allows us to calculate the 
Kullback-Leiber entropy S'^i^{p) using the probability density of order classes Pc (see 
Fig. H]). In this case, equations analog to Eqs. ([7] -[10]) can easily be derived. 

3. Applications 

We apply the method to a bi-directionally coupled Roessler-Roessler system [7] defined 
by the following set of equations 

il,2 = - Wl,2l/1,2 - ^1,2 + k{x2,l - Xi,2), 

yi,2 = wi,2a;i,2 + 0.165yi,2, (11) 

i;i,2 =0.2 + zi,2(xi,2-10). 

where Wi = 0.99 and W2 = 0.95 are the mismatch parameters. All time series were 
generated using a fourth-order Runge-Kutta method with an increment St = 0.001 and 
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the following initial conditions: Xi(0) = —0.4, |/i(0) = 0.6, ;zi(0) = 5.8, X2(0) = 0.8, 
Z/2(0) = —2, and -2i(0) = —4. Results were saved at intervals At = 0.01. This chaotic 
system exhibits a rich synchronization behavior which ranges from phase {k ^ 0.036) 
to lag {k ?a 0.14) and finally complete synchronization as the coupling parameter k is 
increased [7] . The results presented here were obtained using the x-components of the 
Roessler subsystems. Before transforming the time series into symbolic representations, 
they were sampled using a sampling time r = 150At and time series of length L = 2^^ 
(~ 775 orbits) were considered. This sampling time fulfills the condition of minimum 
mutual information of the delay coordinates {xi(t),xi(t + r)) for the uncoupled system 
{k = 0) [15]. Using this settings, we expect a higher response of our measures to the 
influence of the coupling. 

Figures [3]^a)-(c) show Skl for transcriptions in all feasible order classes for p = Q 
and p = 7. Figure [3] (d) shows S'^-^, obtained using the probability density of order 
classes Pc for p = 6 and p = 7. For small values of the coupling constant k, the 
time series behave independently since the Roessler subsystems are uncoupled. For 
k G [0,0.036], Skl indicates that the actual dynamics hardly deviates from that of 
the independent processes. Skl sharply increases at A; ~ 0.036 indicating the onset 
of phase synchronization. At A; ~ 0.061 all curves display a peak which corresponds 
to the presence of a period 3 window [7]. Some curves also indicate the presence of 
a period 5 window at k ^ 0.11. To our best knowledge, the presence of this periodic 
window has not been reported before probably due to the extremely narrow range of 
k values {k G [0.1094,0.1096]) where it takes place. Curves also display a step within 
the coupling range k G [0.232, 0.256] which indicates the presence of period 5 windows. 
Figures [3](a) and[3]^c) show that Skl saturates for some order classes. Saturation occurs 
when an order class vanishes, i.e. no transcription belonging to this order class is 
generated by the coupled dynamics. When this occurs, the KL entropy is not defined 
thus Eq. [To] can not be used. However, for independent processes the probability 
density of transcriptions in this particular order class P^ is non-vanishing. In these 
cases, we found that a reasonable choice is to set Skl to the Shannon information 
entropy Skl = —J2i Pt l^S -^r ^r transcriptions in the vanishing class. 

Figure [3] also unveils another interesting feature of this coupled chaotic system. For 
k ^ [0.11, 0.14], Skl displays fluctuations which are particularly strong in Fig. [3](d) and 
for some order classes, and sharply decrease for k > 0.14. This result provides evidence 
of the existence of a typical behavior known as intermittent lag synchronization [T] [8], 
characterized by synchronization periods interrupted by bursts of non-synchronized 
behavior. These intermittent bursts of activity are responsable for the large fluctuations 
displayed by Skl in this range of coupling values. The absence of these fluctuations for 
higher coupling values indicate that bursts of non-synchronized behavior are no longer 
present thus lag synchronization completely develops. In particular, for p = Q [p = 7) 
Skl for C5 (Cio), which are the most sensitive measures to this intermittent behavior, 
saturate at A; ~ 0.14. This value of the coupling constant is in agreement with the one 
reported in [7] {k = 0.14) for the onset of lag-synchronization. Figure [3] (d) shows that 
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Figure 3. (a) KuUback-Leiber entropy Skl obtained using the probability density 
of transcriptions for all available order classes for p = 6. (b) Skl for transcriptions 
in order classes C2, C3, C4, C5, and Cq for p — 7. (c) Skl for transcriptions in order 
classes C7, Cio, and C12 for p = 7. (d) 5^^ obtained using the probability density of 
order classes for p = 6 (red curve) and p — 7 (green curve). Vertical full lines from 
left to right indicate transitions to phase-, intermittent lag-, and lag-synchronization, 
respectively. Vertical dashed lines and hatched areas indicate periodic windows. The 
values of the coupling constant for transitions and the first periodic window were taken 
from [7]. 



Sj^i^ for the probability density of order classes also reveals features above discussed and 
describes the overall behavior of the coupled system. 

Figure H] (a) and (b) show plots of the probability density Pc^ of the order classes 
for p = 6 and p = 7, respectively. Note that Fig [3] (d) shows the contrast between the 
probability densities shown in Fig. H] and the ones for independent processes. Figure [3] 
(d) indicates that for k = 0.005 the contrast is vanishing {Skl ~ 0) thus the Roessler 
subsystems behave independently. Then, the probability density Pc for k = 0.005 
is similar to that generated by two independent processes. Note that even for two 
random independent processes, the probability density of order classes is not uniform 
since the cardinality of order classes is different. In the vicinity of the transition to 
phase synchronization, Pc deviates from that of the independent processes (see Fig. [3] 
(d)) and higher-order classes dominate the coupled dynamics (see Figs. H] (a) and (b) 
for k = 0.039). This trend is reversed when increasing k and already at A; = 0.062 
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Figure 4. (a) Probability density Pc of the existing order classes for different values of 
the coupling constant k for p = 6. Note that class Cj comprises only one transcription 
(/ = (0, 1, 2, 3, 4, 5)). (b) Idem (a) for p = 7 



{k = 0.074) for p = 6 (j9 = 7) C2 is the most relevant class. Figure H] (a) shows that 
C2 dominates up to large values of k where finally C/ prevails. Figure H] (b) reveals the 
same trend as in (a) except that C2 still dominates at k = 0.299. 

As discussed above, the order of a transcription roughly estimates its "complexity". 
Thus, the probability density of order classes indicates how " complex" the relationship 
between the time series is. Notice that the probability densities of higher-order classes 
decrease when increasing k and some of them vanish like C5 for p = 6, and Cj and 
CiQ for p = 7. In fact, simpler synchronization states like intermittent lag and lag 
synchronization {k > 0.11) are described by lower order classes (C2 and Cj). Clearly, the 
simplest synchronization state, namely complete synchronization, will only be described 
by Cj. However, for more complex synchronization states like phase synchronization 
{k > 0.036), higher-order transcriptions play an important role. 



4. Conclusions 

We presented a method to characterize similarities between time series based on symbolic 
representations which is particularly useful to study synchronization. The properties 
of invariance that order classes satisfy allow us to derive information measures for 
the different order classes. Our results show that different order classes provide 
complementary information of the coupled dynamics. The understanding of the action 
of transcriptions belonging to specific order classes led us to interpret the probability 
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density of order classes as an expression of the " complexity" of the existing relationship 
between the coupled systems. The probability density of order classes shows that more 
complex synchronization states are mainly described by higher-order classes while lower- 
order classes dominate for simpler synchronization states. Our approach to characterize 
synchronization in time series provides a new frame where elements of group theory 
and information theory can be directly combined and applied in a simple way. We 
expect our methodology to be useful for the analysis of the dynamics of a wide range of 
coupled systems, particularly for physiological signals like EEG, where the occurrence 
of synchronization phenomena plays a relevant role. 
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